Correct extrapolation of overlap distribution in spin glasses 
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We study in d — 3 dimensions the short range Ising spin glass with Jij = ±1 couplings at T = 0. 
We show that the overlap distribution is non-trivial in the limit of large system size. 



I. INTRODUCTION 

There has been an upsurge of interest in the Edwards- Anderson model of the short-range Ising spin glass with 
binary couplings, 

« Y^-I.^.S, •/,, : I (1) 

i<j 

in d = 3 dimensions. Several papers addressed the following well-posed question: 

is the overlap distribution P(q) of this model, measured at T = 0, trivial or non-trivial in the thermody- 
namic limit? 

A trivial P(q) consists of a single delta function, P(q) = 5(q — (?ea); a non-trivial P(q) has non- vanishing support also 
for < q < <7ea- Claims were made to the effect that the nature of P(q) bears on the validity of the droplet picture 
(DP) Q versus the scenario based on mean-field theory (MF) 0. Our understanding is that a non-trivial global^ 
P(q) is consistent with both |p[. In this communication we do not take sides in the DP vs MF controversy; rather, 
we address the well-defined technical question posed above. 

Our conclusion is that P{q) is non-trivial at T = 0. 

Berg et al || addressed the issue directly by generating ground states S M = (S^S^, —S^), for 512 realizations {J} of 
systems with sizes L — 4, 6, 8 (and for 7 realizations of L — 12). For each {J} they computed the overlap distribution 
function Pj(q), where the overlap q^ v = (1/N)S^ ■ is calculated between all pairs of ground states fi, v. They 
studied the function obtained by averaging over all realizations, P(q) = [Pj(q)]j. In particular, they evaluated P(0); 
the second moment of the distribution cr 2 (q), and the quantity Xi/ 2 , where x a is defined by 



x a = 2 / P(q)dq (2) 





If P(q) — ► S(\q\ — <7ea)/2 for large L, all these quantities should extrapolate to zero (provided one uses a < <7ea)- Berg 
et al found that all three quantities decrease as L grows; they could, however, fit the data to L~ v , with y = 0.72 ± .12, 
as well as to A + BL~ 3 , indicating consistency with extrapolation to both vanishing and non- vanishing limiting values. 

Hartmann Q also studied the size-dependence of x 1 / 2 and found that it behaves as L~ y with y = 1.25 ± .05, 
indicating a trivial P(q); the same conclusion was reached by Hatano and Gubernatis ^ who studied P(0) at finite 
temperatures. Krzakala and Martin H presented arguments that also support a trivial P(q)- Finally, very recently 
Palassini and Young jl(| evaluated P[q) for a sequence of temperatures and sizes L = 4, 6, 8, 10. They evaluated Xi/ 2 
as function of L and T and demonstrated that the data are consistent with a scaling form. According to their scaling, 
for fixed T > and sizes L ^> L C (T), X\/2 goes to a constant, x°°{T) oc T; hence they find that P{q) is non-trivial at 
T > and trivial at T = 0. 



1 We assume that P(q) is measured for an entire system, whose size is then extrapolated to L — » oo. 
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FIG. 1. The state overlap distribution P(q) for four different realizations {J} for system size L — 8. Each distribution is 
divided to its components. The partial distribution Pj(q) (see text), is represented by a solid line. The rest of the distribution, 
Pj(q) — Pj(q), which includes P}(q), is represented by a dashed line. 



II. OUTLINE OF STRATEGY 



We will argue now that all the studies mentioned measured a compound quantity, X1/2, which is the sum of two 
parts; one which is relevant to the question asked, and another which is irrelevant. Furthermore, for some of the sizes 
studied, the irrelevant part is as large as the relevant one. We will show how can one isolate the relevant part, and 
present the results obtained when this is done. These results indicate that P(q) is non-trivial at T = 0. 

For a particular realization Pj(q) has, at T = 0, the typical form presented in Fig |l|. It has a large peak centered at 
some qq ss ^ea, and one or more smaller peaks. The largest peak is due to the overlap of pairs of states that belong to 
the same pure state. Denote the overlap distribution of such pairs by P}(q). The other peaks, at lower q, are due to 
the overlap between states that belong to two different pure states. The corresponding overlap distribution is P](q) 
and we have 

Pj{q)=P}{q)+P°j{q) and P{q) = P\q) + P°(q) (3) 
where the second equation is the average of the first over all realizations. Hence we can write 

x a = < + x° = 2 f P\q) + 2 f P°(q) (4) 
Jo Jo 

Irrespectively of whether P{q) is trivial or non-trivial, one expects that the width of P l {q) decreases with increasing 
size, since P l {q) — > 5(\q\ — <jea)/2 as L — > oo. Therefore as L increases, the integral x l a decreases towards 0; 

< « L-y* (5) 

On the other hand, the behavior of P°{q) (and x°) does distinguish a trivial P(q) from a non-trivial one; in the 
first case P°(q) — > 0, while in the non-trivial case P°(q) and x° do not vanish as L — > oo. We believe that previous 
analysis was hindered by the lack of ability to decompose P(q) and X1/2 into its two constituent parts; a method that 
we developed recently enables us to perform this task. We describe below how we can use a very recently developed 
method to identify unabiguously, for a large majority of the realizations, a partial distribution Pj(q), which is 
a lower bound to P°(q). For realizations in which this identification is ambiguous we set Pj(q) to zero; averageing 
yields P°(q) = [Pj(q)]j, which is a lower bound on P°(q). The corresponding lower bound on x° is given by 

x° a =2 T P°(q)dq, (6) 
Jo 
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We found that the rate of convergence of P°(q) to its limiting large-!/ form is non- uniform; for the sizes studied, 
convergence (with increasing L) is much slower, and statistical errors are much larger in the interval < q < 0.5 than 
in 0.4 < q < 0.7. Hence we base our analysis on the latter interval, calculate 

p0.7 

X*=2 P{q)dq (7) 

JO. 4 

and show that it approaches a non- vanishing limit as L — > oo. 



III. DECOMPOSING Pj{q) 

Our method has been presented in , together with results obtained for the model ([[]) . Full details of the method 
are given in fl^] ; here we give a brief summary of the main ingredients. 

We have shown that an unbiased sample jll| of M ground states breaks naturally into two large groups, C and 
C. The states of the two sets are related by spin reversal. For a large majority of realizations the set C also breaks 
into two natural subsets, C\ and C^. By natural we mean that the overlap between two states that belong to the 
same group (say C\) is significantly larger than between two that belong to two different groups. This suggest that 
the states in these clusters belong to different pure states, separated by free energy barriers. These barriers consist 
of correlated spin domains Q\ and Q2 , which flip collectively when we move from a state in one cluster to a state in 
another cluster. The spins that belong to Q\ are reversed in at least 95% of the pairs of states [i S C and v G C. 
Similarly, the second largest domain C?2 contains those spins that flip in 95% (or more) of the times we pass between 
pairs states, with one member in C\ and the other in Ci. 

The domains Q\ and Qi play the role of the cores of macroscopic "zero energy excitations" that flip as we go 
from one pure state to another. Q\ separates state space into C and C. Within C, Q2 induces a further non-trivial 
separation of the states, into clusters C\ and C2. Each cluster C a contains one or more pure states. When Q2 is large 
("macroscopic"), a pair of states /i G C\ and v € C2 will belong to different pure states, and their overlap q^ u will 
contribute to Pj(q). Hence, we define a new distribution Pj(q), to which only pairs of states fi £ C± and v G C2 
contribute. This function is a lower bound to Pj(q) 7 since we might have for some realizations a third macroscopic 
cluster, in which case C\ contains states from more than one pure state. When this happens, some pairs of states, 
both taken from Ci, contribute to P°(q), and we do not include them in P°(q). In order to assure that C\ and C2 
indeed do not belong to one pure state, we consider only those realizations for which |^| > 0.05 AT. Otherwise, we set 
P°j{q) = 0. 

The method we used to partition the states was based on a clustering procedure. It is important to stress the fact 
that the main result of the present study, that there are states whose overlap contribution should be separated from 
the self-overlap peak and does not vanish in the thermodynamic limit, does not depend qualitatively on the way the 
state clusters are determined. In fact, any method, which projectes out a particular contribution to P{q) and has a 
nonvanishing weight in the L — > 00 limit, will lead to the same conclusion. The only requirements are that the method 
is applied for all system sizes in the same way and the contribution is measured in absolute weights with respect to 
the total P(q). 

We determined for each L the size distributions {82] /N and found that they are nearly the same for 4 < L < 8, 
indicating convergence. |^| scales as N — L 3 ; for L = 6 the average value of \G2\/N is 0.07 and its standard deviation 
0.09; for L — 8 the numbers are 0.08 and 0.10, respectively. 

Since the limiting size distribution of Q2 is non-trivial, we expect a non-trivial P]{q) as long as C2 does not vanish. 
The size IC2I of this state cluster is determined by the correlation between the spins of Q\ and Q2- If this correlation 
approaches 1, this means that Q2 has a low probability to flip without Q\, resulting in \C\\ 3> IC2I. The average 
correlation between these domains is 

512 = wm g § Ci/ ' (8) 

where = (SiSj) is the correlation between spins i and j. The weight of the contribution to P(q) by pairs of states 
in which G2 is flipped without Q\ or vice versa can be evaluated |ll|] by (1 — c\2)/2. We found [jllj that cyi does 
not extrapolate to 1 as L — » 00. For a realization {J}, in which cyi < 1 and |^| > 0, the function Pj(q) will be 
non-trivial, i.e. it will have a finite support for — 1 < q < 1. 

To show explicitly that this indeed is the case, we studied P°(q) and P(q). The function P°(q) — [Pj(q)]j, presented 
in Fig. ||, is a conservative estimate (and a lower bound) for P°(q). It also has a clear physical meaning. P°(q) is 
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FIG. 2. The partial distribution P°{q) for L — 4,5, 6, 8. It is normalized so that 2 J Q P°(q)dq is its weight in the total P(q). 
For each L the largest error bar is shown. 



the distribution of overlaps between pairs of states on the two sides of the second largest free energy barrier in the 
system. For comparison, we also present the full P(q) in Fig [| 

P°(q) has low values and large relative errors for q < 0.4. In this range its values decrease with increasing L. On the 
other hand, in the interval 0.4 < q < 0.7 it seems to have converged. Therefore we chose this range for our analysis, 
and calculated the integrals x* (see eq. <m)) and 



0.7 



P°(q)dq 



(9) 



The values obtained for L — 4, 5, 6, 8 arc presented in Table Perhaps the most direct evidence for our claim is the 
manner in which the values of i*° level off as the size increases, at 0.047. On the other hand, those of x* decrease 
with size. We performed a fit of the latter to the form 



= A + BL- 



(10) 



X 2 = 



The results of several attempts to fit the data to this form are summarized in Table IE The best fit (with 
1.0 x 10 -5 ) was obtained for y — 2.06(49) and A — 0.042(15), which is close to 0.047. Imposing this value, i.e. setting 
A = 0.047 and fitting B and y, we had a somewhat larger x 2 = 1-1 x 10~ 5 ; imposing A — yields a worse fit, with 
X 2 = 4.2 x 10~ 5 . We believe that these results clearly show that P(q) is non-trivial. 



L 


X* 


x*° 


Xl/2 


x l/2 


4 


0.161(5) 


0.064(10) 


0.157(7) 


0.109(14) 


5 


0.115(5) 


0.048(11) 


0.105(6) 


0.082(15) 


6 


0.096(5) 


0.048(10) 


0.095(5) 


0.074(14) 


8 


0.070(4) 


0.047(12) 


0.062(4) 


0.057(14) 



TABLE I. Values of the observables (defined in eq. 

d). d) and (|)) for different system sizes. 



To make contact with previous analysis we also calculated X1/2 and performed similar fits, the results of which are 

also presented in Table II. As discussed above, in this range of q the function P°{q) has larger statistical fluctuations, 
and is decreasing with size (to a limiting value that is expected to be small, albeit non-zero). Indeed the best fit for 
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FIG. 3. The distribution P(q) for L — 4,5, 6, 8. The size of the error bars is of the order or less than the size of the symbols. 

x 1/2 is attained for y = 2.07(1.51) and A = 0.036(47), with x 2 = 1-0 X 10~ 4 . Note that thisy 2 i s 10 times the value 
obtained when fitting x* . Since our estimated value of A, as well as the estimates of others |j[7| is much smaller then 
the values of Xx/2 used to perform the fit, it is hard to distinguish, by means of this extrapolation, between A = 
and a small positive A. Indeed, when we impose A = or both A = 0, B = 1 we get fits of comparable quality, with 
an exponent which is consistent with Hartmann's estimate. 

Finally, we attempted to fit the data for x°y 9 . The values of x°, 2 for the system sizes used are smaller and noisier 

the the results for x*. Nevertheless, using the same fit for {£y 2 yields minimum of x 2 = 1.5 x 10~ 5 for y = 1.94(1.02) 
and A = 0.040(20), quite consistent with the results obtained for x*. 

The authors thank A. P. Young and M. Palassini for most helpful correspondence. AKH was supported by the 
Graduiertenkolleg "Modellierung und Wissenschaftlich.es Rechnen in Mathematik und Naturwissenschaften" at the 
Interdisziplindres Zentrum fur Wissenschaftliches Rechnen in Heidelberg and the Paderborn Center for Parallel Com- 
puting by the allocation of computer time. AKH obtained financial support from the DFG (Deutsche Forschungs 
Gemeinschaft) under grant Zi209/6-l. ED and GH were supported by the Germany-Israel Science Foundation (GIF). 



fit 


A 


B 


y 


x 2 


x* , best 


0.042(15) 


2.06(1.16) 


2.06(49) 


1.0 x 10~ 5 


a;*, imposed A 


0.047 


2.45(36) 


2.21(10) 


1.1 x 10~ 5 


x* , imposed A 





0.88(13) 


1.24(9) 


4.2 x 10" 5 


Xi/2, best 


0.036(47) 


2.10(3.68) 


2.07(1.51) 


1.0 x 10" 4 


Xi/2, imposed A 





0.97(26) 


1.33(17) 


1.3 x 10~ 4 


Xi/2, imposed A, B 





1 


1.35(2) 


1.3 x 10 -4 


x°/ 2 , best 


0.040(20) 


1.00(1.16) 


1.94(1.02) 


1.5 x 10" a 



TABLE II. Best fit parametrs for x(L) = A + BL~ V . 
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